A grade: { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23 }
B grade: { }
C grade: { }
F grade: { }
A grade: { 1, 2, 3, 4, 5, 6, 8, 10, 12, 13, 14, 16, 17, 18, 19, 20, 21, 22, 23 }
C grade: { 15 }
F grade: { }
A grade: { 1, 3, 5, 6, 8, 10, 12, 13, 14, 19, 20, 21, 22, 23 }
B grade: { 2, 4, 7, 9, 11, 15, 16, 17, 18 }
C grade: { }
F grade: { }
A grade: { 5, 6, 8, 10, 12, 13, 14, 15, 19, 20, 22, 23 }
B grade: { 7, 9, 11, 16, 17, 18, 21 }
C grade: { }
A grade: { 1, 2, 3, 4, 5, 6, 8, 10, 15, 16, 21, 23 }
B grade: { 7, 9, 11, 12, 13, 14, 17, 18, 19, 20, 22 }
C grade: { }
F grade: { }
B grade: { }
C grade: { }
F grade: { 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23 }
A grade: { 1, 3, 5, 8, 10, 14, 19, 20, 21, 22 }
B grade: { 2, 4, 6, 7, 9, 11, 12, 13, 15, 16, 17, 18 }
C grade: { }
F grade: { 23 }
A grade: { }
B grade: { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23 }
C grade: { }
F grade: { }
Detailed conclusion table per each integral is given by table below. The elapsed time is in seconds. For failed result it is given as F(-1) if the failure was due to timeout. It is given as F(-2) if the failure was due to an exception being raised, which could indicate a bug in the system. If the failure was due to integral not being evaluated within the time limit, then it is given just an F.
In this table,the column normalized size is defined as \(\frac {\text {antiderivative leaf size}}{\text {optimal antiderivative leaf size}}\)
Problem 1 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | F(-2) | A | A | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 78 | 78 | 51 | 66 | 0 | 39 | 54 | 63 | 48 |
normalized size | 1 | 1.00 | 0.65 | 0.85 | 0.00 | 0.50 | 0.69 | 0.81 | 0.62 |
time (sec) | N/A | 0.064 | 0.123 | 0.319 | 0.000 | 0.554 | 0.185 | 0.439 | 0.345 |
Problem 2 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | B | F(-2) | A | A | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 37 | 37 | 46 | 93 | 0 | 32 | 48 | 69 | 49 |
normalized size | 1 | 1.00 | 1.24 | 2.51 | 0.00 | 0.86 | 1.30 | 1.86 | 1.32 |
time (sec) | N/A | 0.040 | 0.098 | 0.320 | 0.000 | 0.469 | 0.183 | 0.357 | 0.446 |
Problem 3 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | F(-2) | A | A | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 50 | 50 | 36 | 47 | 0 | 27 | 34 | 51 | 37 |
normalized size | 1 | 1.00 | 0.72 | 0.94 | 0.00 | 0.54 | 0.68 | 1.02 | 0.74 |
time (sec) | N/A | 0.051 | 0.053 | 0.321 | 0.000 | 0.468 | 0.141 | 0.362 | 0.252 |
Problem 4 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | B | F(-2) | A | A | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 25 | 25 | 27 | 47 | 0 | 20 | 26 | 37 | 31 |
normalized size | 1 | 1.00 | 1.08 | 1.88 | 0.00 | 0.80 | 1.04 | 1.48 | 1.24 |
time (sec) | N/A | 0.030 | 0.046 | 0.306 | 0.000 | 0.518 | 0.138 | 0.571 | 0.304 |
Problem 5 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | A | A | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 14 | 14 | 9 | 12 | 15 | 6 | 8 | 10 | 14 |
normalized size | 1 | 1.00 | 0.64 | 0.86 | 1.07 | 0.43 | 0.57 | 0.71 | 1.00 |
time (sec) | N/A | 0.019 | 0.004 | 0.139 | 0.712 | 0.451 | 0.338 | 1.148 | 0.201 |
Problem 6 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | A | A | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 9 | 9 | 9 | 9 | 7 | 11 | 7 | 15 | 11 |
normalized size | 1 | 1.00 | 1.00 | 1.00 | 0.78 | 1.22 | 0.78 | 1.67 | 1.22 |
time (sec) | N/A | 0.032 | 0.003 | 0.291 | 1.077 | 0.432 | 4.825 | 0.490 | 0.247 |
Problem 7 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | B | B | B | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 12 | 12 | 26 | 24 | 33 | 48 | 0 | 30 | 23 |
normalized size | 1 | 1.00 | 2.17 | 2.00 | 2.75 | 4.00 | 0.00 | 2.50 | 1.92 |
time (sec) | N/A | 0.035 | 0.048 | 0.249 | 0.544 | 0.697 | 0.000 | 2.453 | 0.228 |
Problem 8 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | A | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 15 | 15 | 15 | 15 | 12 | 16 | 0 | 12 | 9 |
normalized size | 1 | 1.00 | 1.00 | 1.00 | 0.80 | 1.07 | 0.00 | 0.80 | 0.60 |
time (sec) | N/A | 0.033 | 0.027 | 0.298 | 1.024 | 0.519 | 0.000 | 1.974 | 0.164 |
Problem 9 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | B | B | B | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 28 | 28 | 67 | 58 | 83 | 97 | 0 | 62 | 55 |
normalized size | 1 | 1.00 | 2.39 | 2.07 | 2.96 | 3.46 | 0.00 | 2.21 | 1.96 |
time (sec) | N/A | 0.040 | 0.101 | 0.297 | 0.362 | 0.463 | 0.000 | 0.647 | 0.232 |
Problem 10 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | A | F(-1) | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 33 | 33 | 23 | 28 | 24 | 36 | 0 | 24 | 25 |
normalized size | 1 | 1.00 | 0.70 | 0.85 | 0.73 | 1.09 | 0.00 | 0.73 | 0.76 |
time (sec) | N/A | 0.039 | 0.054 | 0.298 | 0.641 | 0.590 | 0.000 | 0.878 | 0.180 |
Problem 11 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | B | B | B | B | F(-1) | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 40 | 40 | 99 | 92 | 131 | 145 | 0 | 94 | 89 |
normalized size | 1 | 1.00 | 2.48 | 2.30 | 3.28 | 3.62 | 0.00 | 2.35 | 2.22 |
time (sec) | N/A | 0.045 | 0.151 | 0.327 | 0.418 | 0.762 | 0.000 | 0.372 | 0.300 |
Problem 12 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 81 | 81 | 85 | 133 | 106 | 248 | 0 | 151 | 110 |
normalized size | 1 | 1.00 | 1.05 | 1.64 | 1.31 | 3.06 | 0.00 | 1.86 | 1.36 |
time (sec) | N/A | 0.100 | 0.413 | 0.287 | 0.380 | 0.705 | 0.000 | 1.322 | 0.375 |
Problem 13 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 38 | 38 | 48 | 64 | 52 | 118 | 0 | 78 | 44 |
normalized size | 1 | 1.00 | 1.26 | 1.68 | 1.37 | 3.11 | 0.00 | 2.05 | 1.16 |
time (sec) | N/A | 0.065 | 0.156 | 0.253 | 0.549 | 0.478 | 0.000 | 2.511 | 0.266 |
Problem 14 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 12 | 12 | 20 | 13 | 12 | 45 | 0 | 22 | 16 |
normalized size | 1 | 1.00 | 1.67 | 1.08 | 1.00 | 3.75 | 0.00 | 1.83 | 1.33 |
time (sec) | N/A | 0.042 | 0.044 | 0.190 | 0.688 | 0.502 | 0.000 | 0.867 | 0.183 |
Problem 15 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | C | B | A | A | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 72 | 72 | 94 | 173 | 120 | 94 | 0 | 148 | 126 |
normalized size | 1 | 1.00 | 1.31 | 2.40 | 1.67 | 1.31 | 0.00 | 2.06 | 1.75 |
time (sec) | N/A | 0.130 | 0.188 | 0.238 | 0.938 | 0.504 | 0.000 | 0.801 | 0.354 |
Problem 16 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | B | B | A | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 120 | 120 | 151 | 407 | 244 | 184 | 0 | 273 | 263 |
normalized size | 1 | 1.00 | 1.26 | 3.39 | 2.03 | 1.53 | 0.00 | 2.28 | 2.19 |
time (sec) | N/A | 0.193 | 0.263 | 0.238 | 0.685 | 0.911 | 0.000 | 1.958 | 0.501 |
Problem 17 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | B | B | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 101 | 101 | 198 | 232 | 216 | 264 | 0 | 220 | 674 |
normalized size | 1 | 1.00 | 1.96 | 2.30 | 2.14 | 2.61 | 0.00 | 2.18 | 6.67 |
time (sec) | N/A | 0.167 | 1.273 | 0.258 | 0.607 | 0.613 | 0.000 | 0.763 | 0.620 |
Problem 18 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | B | B | B | F | B | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 53 | 53 | 67 | 107 | 107 | 135 | 0 | 108 | 170 |
normalized size | 1 | 1.00 | 1.26 | 2.02 | 2.02 | 2.55 | 0.00 | 2.04 | 3.21 |
time (sec) | N/A | 0.085 | 0.126 | 0.267 | 1.120 | 0.700 | 0.000 | 0.412 | 0.492 |
Problem 19 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 36 | 36 | 38 | 35 | 61 | 98 | 0 | 61 | 31 |
normalized size | 1 | 1.00 | 1.06 | 0.97 | 1.69 | 2.72 | 0.00 | 1.69 | 0.86 |
time (sec) | N/A | 0.027 | 0.031 | 0.179 | 1.883 | 0.835 | 0.000 | 0.473 | 0.284 |
Problem 20 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 66 | 66 | 62 | 84 | 106 | 146 | 0 | 94 | 94 |
normalized size | 1 | 1.00 | 0.94 | 1.27 | 1.61 | 2.21 | 0.00 | 1.42 | 1.42 |
time (sec) | N/A | 0.087 | 0.239 | 0.252 | 0.693 | 0.646 | 0.000 | 0.728 | 0.390 |
Problem 21 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | B | A | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 121 | 121 | 113 | 163 | 283 | 220 | 0 | 201 | 280 |
normalized size | 1 | 1.00 | 0.93 | 1.35 | 2.34 | 1.82 | 0.00 | 1.66 | 2.31 |
time (sec) | N/A | 0.159 | 0.606 | 0.262 | 0.788 | 0.627 | 0.000 | 0.718 | 0.651 |
Problem 22 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | B | F | A | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 12 | 12 | 17 | 13 | 12 | 39 | 0 | 13 | 14 |
normalized size | 1 | 1.00 | 1.42 | 1.08 | 1.00 | 3.25 | 0.00 | 1.08 | 1.17 |
time (sec) | N/A | 0.040 | 0.029 | 0.202 | 0.754 | 0.710 | 0.000 | 0.598 | 0.192 |
Problem 23 | Optimal | Rubi | Mathematica | Maple | Maxima | Fricas | Sympy | Giac | Mupad |
grade | A | A | A | A | A | A | F | F | B |
verified | N/A | Yes | Yes | TBD | TBD | TBD | TBD | TBD | TBD |
size | 20 | 20 | 19 | 21 | 20 | 38 | 0 | 0 | 43 |
normalized size | 1 | 1.00 | 0.95 | 1.05 | 1.00 | 1.90 | 0.00 | 0.00 | 2.15 |
time (sec) | N/A | 0.043 | 0.202 | 0.325 | 0.322 | 0.453 | 0.000 | 0.000 | 0.479 |
The following table is specific to Rubi. It gives additional statistics for each integral. the column steps is the number of steps used by Rubi to obtain the antiderivative. The rules column is the number of unique rules used. The integrand size column is the leaf size of the integrand. Finally the ratio \(\frac {\text {number of rules}}{\text {integrand size}}\) is given. The larger this ratio is, the harder the integral was to solve. In this test, problem number [16] had the largest ratio of [.5385]
# | grade |
|
|
|
|
\(\frac {\text {number of rules}}{\text {integrand leaf size}}\) | |||||||||||
1 | A | 4 | 3 | 1.00 | 13 | 0.231 | |||||||||||
2 | A | 3 | 2 | 1.00 | 13 | 0.154 | |||||||||||
3 | A | 4 | 3 | 1.00 | 13 | 0.231 | |||||||||||
4 | A | 2 | 2 | 1.00 | 11 | 0.182 | |||||||||||
5 | A | 1 | 1 | 1.00 | 11 | 0.091 | |||||||||||
6 | A | 2 | 2 | 1.00 | 13 | 0.154 | |||||||||||
7 | A | 2 | 2 | 1.00 | 13 | 0.154 | |||||||||||
8 | A | 2 | 1 | 1.00 | 13 | 0.077 | |||||||||||
9 | A | 3 | 3 | 1.00 | 13 | 0.231 | |||||||||||
10 | A | 3 | 2 | 1.00 | 13 | 0.154 | |||||||||||
11 | A | 4 | 3 | 1.00 | 13 | 0.231 | |||||||||||
12 | A | 3 | 2 | 1.00 | 13 | 0.154 | |||||||||||
13 | A | 3 | 2 | 1.00 | 13 | 0.154 | |||||||||||
14 | A | 2 | 2 | 1.00 | 13 | 0.154 | |||||||||||
15 | A | 7 | 6 | 1.00 | 13 | 0.462 | |||||||||||
16 | A | 8 | 7 | 1.00 | 13 | 0.538 | |||||||||||
17 | A | 9 | 6 | 1.00 | 13 | 0.462 | |||||||||||
18 | A | 5 | 5 | 1.00 | 13 | 0.385 | |||||||||||
19 | A | 2 | 2 | 1.00 | 11 | 0.182 | |||||||||||
20 | A | 5 | 5 | 1.00 | 11 | 0.454 | |||||||||||
21 | A | 9 | 6 | 1.00 | 13 | 0.462 | |||||||||||
22 | A | 2 | 2 | 1.00 | 13 | 0.154 | |||||||||||
23 | A | 2 | 2 | 1.00 | 13 | 0.154 | |||||||||||